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CLAIMS 

1. An image recognition apparatus for recognizing 
movements of players matched against each other between " 
5 domains partitioned with such an obstacle as net in a sport 
match or game from contents including a television program 
being telecasted to show the sport match or game, an image 
material in an uncompleted state for broadcasting and contents 
recorded in such a recording medium as a VTR, the image 

10 recognition apparatus comprising: a picture information 

obtaining section configured to obtain picture information 
containing an image of a movement of at least one of the 
players playing in the sport match or game from the contents; 
a sound information obtaining section configured to obtain 

15 sound information generated in synchronism with the picture 

information from the contents, the sound information including 
information on a hitting sound generated upon hitting of such 
an instrument as a ball moving between the domains to serve as 
an object of score count in the sport match or game; a hitting 

20 time information specifying section configured to specify a 

hitting time at which the instrument is hit based on the sound 
information obtained by the sound information obtaining 
section; a rule information storage section configured to 
store rule information for carrying out the sport match or 

25 game; and an image substance recognizing section configured to 
recognize a substance of an image containing the image of the 



29 

movement of the player provided by the picture information 
based on the picture information obtained by the picture 
information obtaining section^ a position of the instrument at 
the hitting time specified by the hitting time specifying 
5 section and the rule infoirmation stored in the rule 
information storage section. 

2. The image recognition apparatus according to 
claim 1, wherein when the sound information assumes a value 
higher than a predeteinnined level, the hitting time 

10 information specifying section specifies as the hitting time a 
point in time at which the higher value is assumed. 

3- The image recognition apparatus according to 
claim 1 or 2, wherein: the sound information obtaining section 
is provided with a filter portion configured to permit sound 

15 within a predetermined frequency band to pass therethrough; 

and the sound information is inf orTTiation on the sound having 
passed through the filter portion. 

4 . The image recognition apparatus according to 
claim 3, wherein the filter portion comprises a band-pass 

20 filter. 

5. The image recognition apparatus according to any 
one of claims 1 to 4, wherein the hitting time information 
specifying section is configured to specify the hitting time 
based on hitting sound prospect data including data on a 

25 predetermined time period within which the hitting sound 
extracted from the sound information is generated. 
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6. The image recognition apparatus according to any 
one of claims 1 to 4, wherein the hitting time information 
specifying section is configured to extract plural hitting 
sound prospect data items from the sound information in such a 
5 manner that a hitting sound prospect data item generated at 

one point in time and a subsequent hitting sound prospect data 
item generated at a succeeding point in time share data on a 
same time and then specify the hitting time based on the 
plural hitting sound prospect data items . 

10 7. The image recognition apparatus according to 

claim 6, wherein the plural hitting sound prospect data items 
have equal data length, while the hitting time information 
specifying section is configured to extract the plural hitting 
sound prospect data items from the sound information at 

15 constant time intervals. 

8 . The image recognition apparatus according to any 
one of claims 1 to 7, further comprising a hitting sound 
pattern information storage section configured to store 
hitting sound pattern information including information on 

20 patterns of sound changes that occur depending on how the 

instrument is hit by such an instrument as a racket constantly 
held and used by each of the players, wherein the hitting time 
information specifying section is configured to specify the 
hitting time based on the hitting sound pattern information 

25 stored in the hitting sound pattern information storage 
section and the sound information. 
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9. The image recognition apparatus according to any 
one of claims 1 to 8, wherein the picture information 
obtaining section includes a domain element extracting section 
configured to extract from the picture information facility 

5 information including information on the obstacle, information 
on the domains and information on boundary lines between each 
of the domains and an area outside the domain, player's 
position information indicative of a player' s position, and 
instrument information on the instrument moving between the 
10 domains to serve as an object of score count in the sport 
match or game. 

10. The image recognition apparatus according to 
claim 9, wherein the player's position information is position 
information on a domain containing each of the players and the 

15 instrument constantly held and used by the player. 

11. The image recognition apparatus according to 
claim 9 or 10, wherein the domain element extracting section 
is configured to extract the player' s position information 
from the picture information based on the facility information 

2 0 extracted by the domain element extracting section. 

•12 . The image recognition apparatus according to any 
one of claims 9 to 11, wherein the domain element extracting 
section is configured to extract the instrument information 
from the picture information based on the facility information 

25 and the player's position information extracted by the domain 
element extracting section. 
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13. The image recognition apparatus according to any 
one of claims 9 to 12, wherein the facility information, the 
player's position information, the instrument information and 
the rule information are based on knowledge about a sport as a 

5 subject for image extraction. 

14. An image recognition program cooperative with a 
computer for causing an image recognition apparatus to operate 
to recognize movements of players matched against each other 
between domains partitioned with such an obstacle as net in a 

10 sport match or game from contents including a television 

program being telecasted to show the sport match or game, an 
image material in an uncompleted state for broadcasting and 
contents recorded in such a recording medium as a VTR, the 
image recognition program being configured to cause the image 

15 recognition apparatus to function as: a picture information 
obtaining section configured to obtain picture information 
containing an image of a movement of at least one of the 
players playing in the sport match or game from the contents ; 
a sound information obtaining section configured to obtain 

2 0 sound information generated in synchronism with the picture 

information from the contents, the sound infoinnation including 
information on a hitting sound generated upon hitting of such 
an instrument as a ball moving between the domains to serve as 
an object of score count in the sport match or game; a hitting 

25 time information specifying section configured to specify a 

hitting time at which the instrument is hit based on the sound 
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information obtained by the sound information obtaining 
section; a rule information storage section configured to 
store rule information for carrying out the sport match or 
game; and an image substance recognizing section configured to 
5 recognize a substance of an image containing the image of the 
movement of the player provided by the picture information 
based on the picture information obtained by the picture 
information obtaining section, a position of the instrument at 
the hitting time specified by the hitting time specifying 
10 section and the rule information stored in the rule 
information storage section. 



